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Assume we are given a nxn binary image containing horizontally convex features; i.e., for each 
feature, each of its row’s pixels form an interval on that row. In this paper we consider the 
problem of assigning topological numbers to such features; i.e., assign a number to every feature/ 
so that all features to the left of / ub the image have a smaller number assigned to them. This 
problem arises in solutions to the stereo matching problem. We present a parallel algorithm to 
solve the topological numbering problem in 0{n) time on an nxn mesh of processors. The key 
idea of our solution is to create a tree from which the topological numbers can be obtained even 
though the tree does not uniqiely represent the “to the left of ' relationship of the features. 
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I. Introduction 

Assume we are given an nxn binary image in which we refer to the image positions con- 
taining a T (resp. ’O’) as containing a 1 -pixel (resp. 0-pixel). The connected components, 
which we call features, formed by the 1 -pixels are horizontally convex, i.e., for each feature, 
each of its row’s 1-pixels are contiguous on that row or, equivalently, form an interval on that 
row. An example of an image containing a horizontally convex feature is shown in Figure 1. 



A horizontally convex feature 
Figure 1 

Observe that the features do not need to be vertically convex. For horizontally convex features 
the relationship "to the left of' defines a partial order as follows. A feature /is to the left of a 
feature g, denoted f{ g, if and only if a 1-pixel of / is to die left of a 1-pixel of g on some row 
of the image. If no such row exists then / and g are incomparable . The topological numbering 
problem is to assign to every feature in the image a unique number so that for any feature/, all 
features to the left of / have a smaller number assigned to them. The need for topological 
numbering of features arises in solutions to the stereo matching problem [OK]. In this paper we 
present a parallel algorithm that determines the topological numbers in 0(n) time when the 
image is stored in an nxn mesh of processors, one pixel per processor. 

We next explain briefly how the topological numbering problem arises in the context of 
the stereo matching problem. In the stereo matching problem we are given two images, L and R, 
of a 3D scene and the objective is to determine the coordinates (x,y,z) of a point in the 3D 
scene from its image points (x/,y/) in L and (x r> y r ) in R. The heart of the stereo matching prob- 
lem is finding corresponding points in the two images of the same scene [BF, BT, GK, MP]. An 



-3- 


elegant dynamic programming solution is given by Ohta and Kanade [OK]. One of the subprob- 
lems that needs to be solved in their algorithm is that of establishing precedence between hor- 
izontally convex features of an image by assigning topological numbers to them. The sequential 
algorithm given in [OK] for numbering features is based on performing a topological search on 
a directed acyclic graph. The directed acyclic graph is obtained by making every feature a vertex 
and introducing a directed edge from / to g if / { g and there exists at least one horizontal line 
in which no other feature is met when going from / to g on that line. The so obtained directed 
acyclic digraph has at most 0(n 2 ) vertices and 0(n 2 ) edges and a topological search on it 
correctly numbers the features. If topological numbers are obtained for both images L and R, 
then they are used to enforce consistency in the matching process as follows. If the algorithm 
decides to match feature // of L with feature /, of R, then all features in L with a smaller 
number than / can only be matched with features in R that have a smaller number than/. 

In the next section we describe our algorithm that determines the topological numbers in 
0 (n) time when the nxn image is stored in an nxn mesh of processors with one pixel per pro- 
cessor. We assume the mesh to be an SIMD (Single Instruction, Multiple Data) machine in 
which every processor has a fixed (i.e. 0(1)) amount of of local storage [B]. Our algorithm 
determines the topological numbers by solving a graph problem. Its basic idea is quite different 
from the one used by Ohta and Kanade [OK]. We cannot afford to parallelize the topological 
sort on that directed acyclic graph since topological sorting on such a graph does not seem to 
lend itself to an efficient parallel solution. Instead, in our solution we construct from the image a 
rooted, directed in-tree and we obtain the topological numbers by performing computations on 
that tree. 

n. The Algorithm 

Throughout we will index the processing elements (PEs) of the mesh by either their row- 
major index or by their row/column position. Figure 2 illustrates the row-major indexing 
scheme. The PE at row i and column j is denoted by PE(iJ). We let position (0,0) of the mesh 
(and thus the image) be the top left PE of the mesh. The input to our algorithm is an nxn binary 
image /, where / (/,;) is stored at PE (:,;)• Our algorithm assumes that every PE containing a 1- 
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A 4x4 mesh with row-major indexing 
Figure 2 

pixel also contains the connected component number of the corresponding feature. We further- 
more assume that the component numbers are assigned so that the number of a feature is the 
largest row-major index of any PE containing a 1 -pixel from that feature. That is. the number 
of a feature is the row-major index of the lowest rightmost 1 -pixel in it Numerous parallel 
mesh algorithms to label the connected components in O («) time are known [CSS, H, HT, MS, 
NS] and they can easily be modified to label the features as needed by our algorithm. We refer 
to the component number stored at PE (/,/) as C{i,j). The output of our algorithm is array TN, 
where TN ( /,/ ) contains the topological number of the feature containing the 1 -pixel at position 
<*./)• 

One seemingly obvious algorithm for determining the topological numbers is based on the 
"sweepline" method. A horizontal line is used to sweep the image, for example, from right to 
left The first time a 1-pixel of a feature g is encountered, it is given a topological number such 
that feature g is given a larger number than feature / if and only if feature g is encountered 
before feature / in the right-to-left sweep. An image on which the method fails is shown in Fig- 
ure 3. 

Our algorithm consists of three steps which are described next In the first step it creates 
from the input image 7 a rooted, directed in-tree T in which the features correspond to the ver- 
tices. We create a root vertex which corresponds to an artificially created feature running along 
the length of the left border of the input image (introducing this "dummy” feature simplifies the 
exposition). The edges of the tree are created as follows. If PE(i,y) contains a component 
number equal to its row-major index, then PE(i,j) initiates a horizontal scan leftward on row i. 


I 
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line sweeps right-to-left 

◄ 



Illustrating why a "sweepline" method does not work 
Figure 3 

The component number is taken along on this scan. In Figure 4(a), the processors initiating such 
a scan are circled. Thus a processor initiates a scan if and only if it contains the lowest right- 
most 1-pixel of a feature. 




(a) Features indicated by component numbers; 
arrows show scans done in step 1 


(b) Rooted directed tree created from (a) 
with preorder and component numbers 


Figure 4 

From now on we will refer to the largest row number (i.e. geometrically lowest row) containing 
1 -pixels belonging to feature / as low(/). For example, in Figure 4(a), low(12)=2, and 
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low(47)=5. If feature / contains more than one 1-pixel in low (f), then the scan may travel 
through other 1 -pixels belonging to /. The scan initiated at PE (/,/) stops when it reaches the 
first 1 -pixel belonging to a different feature g. For example, in Figure 4(a), the scan initiated at 
the circled ’85’ stops at the tip of the arrow starting from it (i.e., at a *90’). If the scan stops at 
PE(i,/), /</, the directed edge (C (/,;), C (/,/)) is created in the PE(/,/). The graph created in 
this step is an acyclic digraph in which every node has out-degree exactly one, except one node 
which has out-degree zero (the "dummy" feature, labeled ’90’ in Figure 4(a)). It is easy to see 
that this graph is actually a directed in-tree rooted at the node of out-degree zero. Figure 4(b) 
shows the tree created from 4(a). In figure 4(b), notice that the children of any node are drawn 
from left to right by increasing component numbers. Thus T is, in some sense, an ordered tree. 


The rooted, directed in-tree created by our algorithm does not contain all the information 
about the partial order. Figure 5 illustrates three distinct partial orderings that give rise to the 
same tree. 



Illustrating distinct partial orderings that give rise to the same tree 

Figures 

Contrast this with the directed acyclic graph of Ohta and Kanade [OK], whose transitive closure 
is exactly the " •{" relationship. However, the tree created in our algorithm contains all of the 
crucial information needed to compute the topological numbers, and the simple structure of a 
tree allows us to generate these numbers in 0(n) time. 


The second step of the algorithm takes the rooted, directed in-tree T and computes the 
preorder numbers of the vertices of T using the Atallah-Hambrasch algorithm given in [AH]. 
When computing the preorder numbers it is crucial that the children of every node are visited in 
the order of increasing component numbers. As we will show in the next section, for any two 
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features /and h with with f{ h, the preorder number of / is smaller than the preorder number of 
h. Hence, the preorder numbers are correct topological numbers. The preorder numbers for the 
tree shown in Figure 4(b) are given inside the circles indicating the vertices. After the preorder 
numbers have been assigned, the final step of the algorithm broadcasts them from the vertices of 
T to all 1 -pixels of the corresponding features in /, thus creating the array TN. This "broadcast- 
ing" is done in 0(n) time using methods described in [H, MS, NS]. 

HX Correctness 

In this section we prove the correctness of the algorithm outlined in the previous section. 
We denote the preorder number assigned to feature / as pre(/)- Recall that in the algorithm 
preorder numbers are assigned to the vertices such that if a vertex has two children u and v and 
u <v, then pre(u) < pre(v) (i.e., vertex u is visited before vertex v in the traversal). Before show- 
ing that the preorder numbers are topological numbers, we introduce the notion of an image 
path, and then give a lemma. 

Let wo, wj, • • • , w*_j , w k be the vertices on the path from feature wo to w* in T. The 
image path F(w 0 ,w t ) consists of all the 1 -pixels in feature wo, all the 1 -pixels in feature w; that 
are on a row greater or equal to low(w,_i), l£/££, and of all the 0 -pixels traversed during the 
horizontal scan from feature w; to w, + j , Q£/*SJfc-l. See Figure 6 for an example of an image 
path P(w 0 ,^ 3 ). Observe that the set of pixels included in an image path is connected and hor- 
izontally convex. 

Lemma. Let P(w 0 ,w k ) and F(«o,“/) be two image paths with w 0 *u 0 and w**u;. There can- 
not exist a 1 -pixel that is in bothFCwo.w*) and P(uo,ui). 

Proof. Assume there exists such a 1 -pixel. If there exists more than one, choose the highest, 
rightmost one. Let x be this 1-pixel. An image path consists of portions of features and hor- 
izontal lines, and since x is in both image paths, x must come from a feature. W.l.o.g. let w ( - be 
this feature. Both image paths contain all the 1 -pixels of feature w,- within and below the row 
containing pixel x. Hence, both image paths contain the same set of 1 -pixels from this point on 
and w k *u t is not possible. D 
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Example of an image path P (wo,w 3 ); image path includes 
shaded poitions of the features and the horizontal lines. 

Figure 6 

Theorem. For any two features / and A with f\ A, we have pre(/) < pre(/t). 

Proof. Let / and A be 2 ny two features with f{ A. If A is a descendant of / in T, then, due to 
the definition of preorder numbering, feature / is assigned a smaller preorder number than 
feature A and the theorem follows. , 

Assume now that A is not a descendant of /in T. Let d be the common ancestor of / and A 
that is lowest in T (i.e. f farthest from the root in T). Let u and v be the two children of d such 
that / is a descendent of u and A is a descendent of v. To show that pr z(f) < pre(A), it suffices to 
show that low(u) < low(v), since this would imply that u occurs before v in the ordered list of 
d's children (i.e., it would imply u < v). This in turn would imply that the preorder traversal 
visits u and its subtree before v and its subtree, and hence that pre(/) < pre(A). We now show 
that low(u) < low(v). 

Assume by contradiction that low(u) £ low(v). If low(u) = low(v), then u and v cannot 
both be children of d in T, and therefore low(u) > low(v). Since f\h, there exists a row i such 
that a 1-pixel x of /is to the left of a 1-pixel y of A. Let (resp. T| v ) be the rightmost 1-pixel 
of u (res p. v) in row 1ow(m) (resp. row low(v». Figure 7 shows x, y, r|„, ri„, and the relative 
positions of the image paths P(f,u) and P(A,v). In particular, P(f,u) contains the pixels x and 
P (A,v) contains the pixels y and ri». and T|v is to the right of P(f,u). (If rj» was to the left 
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of P(f,u), thenP(/,u) and P(h,v) would intersect, violating the previous lemma). 



Figure 7 

Since d ij the parent of v in T, there is a 1-pixel of d in between P(f,u) and rj v on row 
low(v). Let t be such a 1 -pixel. Since d is also the parent of u, there is a 1 -pixel of d to the left 
of P(f, u) on row low(u). Let f be such a pixel. Figure 7 shows both t and f. Since d is hor- 
izontally convex, the only way for t and f to be in the same feature d is for d to cross P if ,u). 
This is not possible and thus we have low(u) < low(v). D 

IV. Implementation 

We now show that each step of the algorithm can be implemented in 0 ( n ) time on a mesh 
of size ax*. All of the leftward scans are obviously completed within n time steps. It is also 
easy to see that at most one edge (C (/,;), C(i,f )) is created in PE(i,j‘). This holds since, for a 
1-pixel located at position PE(i,/) belonging to a feature/, there is at most one PE (i,j) contain- 
ing a 1 -pixel belonging to a different feature g immediately to the right of PE (/,/) on row /. 
Once the rooted, directed in-tree T has been created, we use the algorithm described in [AH] to 
assign the prcorder numbers to the vertices of the tree in O ( n ) time. The algorithm in [AH] 
assigns preorder numbers to the vertices of T in the manner required by our algorithm; i.e., for 
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any vertex in T with children u and v, u is visited before v if and only if low(u) < low(v). The 
input to the preorder algorithm consists of the edges of T as stored in the PEs after the leftward 
scans have been completed. If edge (C (i,j), C (/,/)) is stored in PE(/,/) before the preorder 
numbering occurs, then we can assume that the preorder algorithm returns (C (:,/), C (/,/)) to 
PE (/,/), In addition, we can assume that the preorder algorithm returns to PE (/,/) the topologi- 
cal number for the feature that contains the 1-pixel at PE 

The final step is to broadcast the preorder number stored in PE (i,/) to all 1-pixels of the 
corresponding feature. The broadcasting can be done in 0(n) time in a number of ways. One 
way is to first sort by component number all 1 -pixels belonging to each feature / along with 
C(i,j) and the preorder number stored in PE (/,/). The correct topological number is then 
assigned to all the 1-pixels of /and the 1-pixels are then sorted back to their original position in 
image /. Another way of implementing the final step without an explicit sort first sends the 
preorder number from PE(/,/) rightward to PE (/,». The array TN is then created by performing 
a connected component computation which accomplishes the broadcast. This concludes the 
description of our O (n) time algorithm for determining the topological numbers of features. 


V. Conclusion 

In this paper we gave an O (n) time algorithm for topologically numbering horizontally 
convex features of an nxn binary image on an nxn mesh of processors. The topological number- 
ing problem is to assign to every feature in the image a unique number so that all features to the 
left of a feature / have a smaller number assigned to them. Our algorithm solves this problem 
by constructing a rooted, directed in-tree from the image and by determining the preorder 
numbers of the constructed tree. 
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